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[57] ABSTRACT 

An apparatus and method enables a user to control the 
selection of electronic multimedia services to be provided to 
the user by one or more servers over a communication 
medium. The apparatus includes a scanner for reading marks 
on an object and for communicating a request signal, having 
an object code representing the read marlcs, to a user 
interface. The interface receives the request signal and 
transmits to the servers a request conomand including an 
interface identification code and the objea code which is 
used to select the desired electronic multimedia service. The 
servers identify the selected electronic multimedia service 
using the object code. The interface then enables the selected 
electronic multimedia service transmitted from the servers to 
be received by the user's receiver. 
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MULTIMEDU SERVICE ACCESS BY books by flipping through the pages and glancing at photo- 

READING MARKS ON AN OBJECT graphs and text A collection of printed color photographs 

_______ can be much easier and quicker to biowse through than a set 

TECHNICAL FIELD jjn^ges. Paper has a number of useful properties: 

The invention relates generally to multimedia systems s it is easier and faster to rcad» mark, and manipulate; it is 

and. more specifically, to a method and apparatus for con- portable, familiar and easily distributed Many electronic 

trolling access to midtimedia services. systems attempt to replace paper, but it can be better for 

BACKGROUND OF THE INVENTION them to work with paper exploiting its advantages to 

provide better access to multunedia information. 

Interactive electronic services, video-on-demand, and the lo example, U.S. Pat. No. 4,947,028, issued to J. M. 

^information superhighway" wiU provide access to thou- Corog on Jun. 8, 1993, describes an automated order and 

sands of movies, home shopping information, games, and payment system which uses a ScanFone (trademark of U.S. 

other multimedia documents . A significant problem in using Q^^y xhe ScanFone is a telephone with an attached credit 

these systems is how to browse through the enormous card reader, a small alphanumeric display, and a bar-code 

choices to discover what is avaHable, and to select items of 15 scanner. Customers can use this ScanFone to pay bills and 

interest. The conventional approaches to solving this prob- merchandise from catalogs by scanning bar codes, 

lem are to use channel surfing, use advertisements on ^rhis is an electronically supported, paper catalog home 

preview channels that act as entry points to other movies, shopping appUcation. It is phone-based, however, and does 

and use hierarchical menus that users can navigate through enable the deUvery of multimedia signals over the 

with a remote control to make selections. These approaches 20 established connection to a user's multimedia terminal (e.g., 

do not scale up well to allow rapid browsing of the thou- television) 

sands of multimedia documents that will be available. ^^^^^ ^ ^ iUustrativdy consists of 

Interactive television (TTV) systems will be able to oneor more hand-held scanners or pens (11) that read marks 

present the user with informaaon displayed on the screen, (g^g,^ ^ar codes, alphanumeric characters, or Xerox glyphs) 

muchasPCuserinterfacesdotoday.TheserrVsystemswill 25 on the surfece of an object The object may be paper, plastic 

be limited, however, by the low resolution of NTSC screens, ^j. ^ther material. The object may also be mounted onto or 

and the low resolution of pointing devices that are usable 5^ integral part of an item as a means to identiiy that item, 

from aaoss a room. When it comes to ma^g rapid selec- ^ contemplated that each photograph or 

faons from a large number of choices, ITV systems are „ «,™*«i^r™ 

awkward and slow to use 30 advertisement in a newspapa, magazme, or catalog can be 

awKwara ana slow to use. 30 accompanied by a printed bar code or alphanumeric ID. In 

SUMMARY OF THE INVENTION order to retrieve the associated multimedia document, a user 

-me invention provides an apparams and method for ^^^^ ? seamier or pen (11), and the 

cnablingauscrtocontroltheselcctionofelcctronicserviccs movie Product mform^^^ or game immcc^atc y starts to 

to be provided to the user by one or more servers over a 35 P^^^' :^ """^f^ t T^*"?' ^ be pubhsh^ (by the service 

communication medimn. The apparams includes a seamier Fovider or by third parties) catermg to individual mterests, 

meansforreadingmarksonanobjectandforccmmmucat- ^'S- old movies, h^Tor films, or multi-user mtcracUve 

ing a request signal, having an object code representing the 8™^?' Newspaper advertisements, magazmes, books and 

read marks, to a usa: interface. The interface receives the Pamphlets can also include these prmtcd marks just as they 

request signal and transmits to the servers a request com- 40 ^^^.f ^ P*'^ """^Y'^' J^?"""' ' f^^""^ '"^^ ."^ 

mand including an interface identification code and the P^^^^ 'P.^'^f^ ^^^8 applications 

object code to select the desired electronic service. Hie P^*^ 

apparatus then enables the selected electronic service trans- scanner 11 communicates to the user interface unit 15 

mitted from the servers to be received by the user's receiver. C^-g-' ^ set-top box) through a cable, a wire pair (e.g., see 

In one illusnrative embodiment, the servers are multimedia 45 scannarpen 11 and wire path 18), an infra-red link, or a radio 
servers and the electronic service is a multimedia program. 

According to other aspects of the invention, the scanner ^ illustrative scanner pen 11 is shown in FIG. 4 to 

means may communicate to the interface means over an include a scanning head 401 to read marks on the object 

infra-red link, a radio link, or over a wired connection. The ^^^Z scanned. The transceiver 402 communicates the 

scanner means may read marks such as bar codes, alphanu- so unprocessed output from scanning head 401 over radio link 

mcric characters or Xerox glyphs. The interface means may }^ Optionally, the scanner pen U may include a controUer/ 

be adapted to receive and transmit over a wire pair, cable, interpreter which decodes the unprocessed ou^ut from 

optical or radio coramuoicatiott medium. scanning head 401 into a more conq)act or standardized code 

or format for communication over radio link 12. Switch 406 

BRIEF DESCRIFnON OF THE DRAWING enables the user to turn on and turn ofif seamier pen 11 to 

In the drawing, conserve the battery 407. 

FIG. 1 shows an illustrative system incorporating the According to another aspect of the invention, an optional 

present invention; memory 404 may be provided to enable the user to scan in 

FIG. 2 illustrates how the system might be used; at one time and transmit at a later time. The later transmis- 

FIG, 3 is an illustrative flow chart describing the opera- 60 sion can be controlled by a transmit control button 405. An 

tions of the present invention; and optional display 408 may provide visual feedback for com- 

FIG. 4 shows an illustrative block diagram of a scanner nmnication to interface IS or to display previously scanned 

pen in accordance with the present invention. ^ ^ human-readable format A scan control button 

would enable a user to scroll through a plurality of previ- 

DETAILED DESCRIPTION ously scanned marks. 

The present invention recognizes that people are very The memory may also store a scanner pen identification 

skilled at browsing tfuxjugh paper catalogs, magazines and (ID) code to, for example, distinguish signals from different 
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scanner pens which conununicate with intoface 15. Scaoncx 
pen ID codes could be used to uniquely identily the user, if 
each user has his/her own scanner pen. In interface 15, the 
controller can then compare the scanner ID code against a 
previously stored authorization table to determine if the 5 
uscr*s request is authorized. For example, user requests 
which involve a charge for a particular service may only be 
authorized for a parent* s scanner pen but not for a child's 
scanner pen. If authorized, the interface would include the 
scanner ID code as part of the scanner command sent to the lO 
servers 17. The scanner ID code may then be used by the 
servers 17 for the accounting or bilHng for services identi- 
fied in the user request command. 

An optional audible transducer may also be provided in 
scanner pen 11 to provide audible feedback to the user that 15 
a successful scan of the object has been pcrfonned and/or 
that the interface 15 has received the transmission from the 
scanner pen. Obviously, the interface 15 could also cause the 
display unit e.g., television 16, to display a feedback audio 
or visual message to the user. 2° 

A scanner may be a separate pen or may be part of a 
remote control unit which provides remote control functions 
for the interface unit 15 and/or television 16. 

The interface unit 15 includes means to provide audio and 
visual feedback to the user and means to transmit codes 
received from the scanner. The interface unit 15 transmits 
over communication network 14 to the head-end multimedia 
server 13. An optional telephone 19 which connects to 
interface unit 15 may be used to establish a connection to 
server 13. The interface unit 15 may be incorporated as part 
of a VCR or television receiver. In such an arrangement, the 
scanner 11 may include VCR or television remote control 
fianctions. 

The communication network 14 may be provided by a 35 
cable TV company or telephone company or both and can 
use wire pair or coaxial cables, fiber optic cables, or wireless 
technology. Moreover, the interface unit (also referred to as 
an interface) 15 can also interface to, or be integrated with, 
a telephone set, a cable TV unit at the user location. The ^ 
interface unit 15 and television 16 may together be imple- 
mented in a well-known manner using, for example, a 
multimedia computer including a controller, memory, trans- 
mitter and receiver units, display unit, etc., so as to imple- 
ment the features described herein, 45 

The multimedia server 13 may alone or together with one 
or more other servers 17 have access to or store large 
numbers of movies, movie previews, games, or any of the 
other well-known information that is electrically accessible 
by a user. The multimedia servers 13, 17 may provide a 50 
variety of multimedia services including prerecorded mul- 
timedia programs, instructional multimedia programs, and 
live multimedia programs. The multimedia service may 
illustratively include prerecorded video movie previews-on- 
demand, videos, games, etc. The multimedia services may 55 
also be live or prerecorded entertainment or sporting events, 
etc. The instructional multimedia service may, illustratively, 
be a maintenance p*ogram for a particular product, an 
assembly program for assembling a product, an educational 
tutorial, etc. The live multimedia program may, 
illustratively, include a live connection to a person or 
computer which may provide additional instructional infor- 
mation to the user. The user communicates with the person 
or interacts with the computer via telephone 19a. 

While the present invention will be described as using 65 
multimedia servers 13, 17, it should be understood that the 
servers could, more genaally, be used to provide audio 
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programs, video programs cm: electronic documents to the 
user. Multimedia server 13 can handle service requests from 
thousands of customers at the same time. Once a user's input 
selection is processed, the server 13 sends multimedia data 
or programs down to the interface unit 15, which displays it 
on the user*s television (TV) receiver 16. 

The servers 13 and 17 may illustratively be part of one or 
more interactive television (TTV) networks 18, which may 
connect to conununication network 14. The interactive tele- 
vision (ITV) network may, iUustratively, be implemented as 
described in U.S. patent application Scr. No. 07/965,492 
entifled "Interactive Television Converter" filed Oct. 23, 
1992; U.S. patent application Ser. No. 07/997,985 entitied 
"Program Server For Interactive Tdevision System" filed 
Dec. 28, 1992; U.S. patent appUcation Ser, No. 08/056,973 
entitied *Tntegrated Television Services System" filed May 
3, 1993; and U.S. patent application Ser. No. 08/056,974 
entitied "System For Composing Multimedia Signals For 
Interactive Television Services'* filed May 3, 1993; all 
assigned to the assignee of the present invention and incor- 
porated herein by reference as if set forth in their entirety. 
The rrv network 18 may be part of a larger global sarvo" 
network which may include video-on-demand servers, inter- 
active TV servers, video telephone servers, broadcast TV 
servers, game servers, and user control panel servers. 

Communication network 14 may include a national or 
international asynchronous transfer mode (ATM) network. 
In accordance with the present invention, a universal iden- 
tifier is used to uniquely address every accessible electronic 
object on this network (sort of like a super phone number). 
One way to use scanner pen (hereinafter pen) 11 is in 
combination with marks 10 that represent a unique identifier 
code for electronic objects accessible on the ITV network 
18. These codes could work in a similar way as the well- 
known Universal Resource Locator (URL) identifiers in 
NCSA Mosaic (Internet client access software for World 
Wide Web), only they would be read fixim paper (instead of 
typed into an application) or invisibly linked to on-screen 
buttons. Because of the enormous number of objects that can 
be accessed, these codes need to be large, and standard 
bar-codes would become too large to be placed unobtru- 
sively in paper publications. For this appUcation, Xerox 
glyphs are more appropriate, because they can encode a 
large amount of data in a short space. 

Another possibility is for the scanner pen 11 to scan 
alphanumeric characters. These characters could spedfy a 
unique identifier for a multimedia program, or they could be 
plain text that relates to some multimedia documents stored 
in the ITV network 18. The servers 13, 17 could match this 
text to keywords that describe stored documents on the 
network using well-known information retrieval techniques. 
This would enable the servers to select the multimedia 
document(s) that best match the keywords that the usa: 
scans, and offer them for viewing. One example of how this 
might be useful is for retrieving video clips of news or sports 
stories printed in newspapers and magazines. 

Depending on how much data is represented by the marks 
10, it may be possible to access any electronic object on the 
rrv network 18 with a single swipe, or it may be necessary 
to make two ot more swipes, first to identify a service and 
establish a connection to it, and then to identify a domain 
witiiin that service, and finally to identify a specific elec- 
tronic object controlled by that service, 

FIG. 2 pictorially illustrates how one embodiment of the 
system might be used. In step 1, the user selects a film from 
a paper catalog and scans the identification (ID) marks next 
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to the description of the film with the scanner pen 11. The foimed. In step 310, communication is terminated between 
pen U transnuts scanned information from the paper to the the server and the user in accordance with the user's desires, 
interface unit 15 (also referred to as an interface). In step 2, the end of the session, or other predefined criteria, 
the interface 15 interprets the information sent by the pen 11 Other possible users of the pres ent invention are identified 
and communicates wiflithc multimedia server to request the s below. Each of these applications makes use of the previ- 
movie that the user has selected. In step 3, the server ously described basic hardware and the same basic pro- 
transmits the film which begins to play on the TV monitor, cesses. The differences are in what information is 
Desirably, there should be almost no time lag between steps transmitted, and what the codes are printed on. 
2 and 3; but if there is a delay, then the multimedia server Product assembly and service instructions 
would output a message to the TV screen to indicate that the xq A customer receives a Uwn tractor, or complex piece of 
film is in the process of being retrieved. computer equipment, and each piece in the box is labeled 

.»tt- u with a bar code. When the customer scans these codes, video 

Using this technique, a user may quickly browse through . " V r ^udwiua. j 

J ^ . . ^ ' . . J rf™ r ^ instracUons instantly play to demonstrate how the part needs 

and preview dozens of movies or stored TV programs ma ^^^^ ^^^^^ ^ ^^^4 j^^^^ ^ ^ ^^^^ 

few mmutes.To actuaUy purchase a movie, the systemmay through printed manuals to discover what a part is caUed and 

prompt the user, at the conclusion of a preview (or dunng a 15 ^^at to do with it The objects themselves lead you through 

preview), and ask the user to signal his/her confirmation of process. 

the purchase by using one of the control buttons 405. j^^^g magazines and newspaper access to TV footage 

Alternatively, predefined control marks, shown by 17 in subscribers read through a newspaper or magazine, 

FIG. 2, may be used to control various functions of the they may be interested in seeing associated video footage, 

interface 15 and television 16. Illustratively, these control 20 While reading the sports pages (e.g., 5pom7//«^mjf^<0, key 

fiinctions may include the standard type VCR control func- events could be instantly recalled and played on demand, 

tions (start, stop, pause, etc.) as well as ordering functions e.g., the moment an Olyirpic skier falls, the winning goal, 

(e.g., using an "order" mark).As shown in FIG. 2, a user can etc. News stories can allow readers to instantiy play 

scan a predefined "order" mark to place his/her purchase interviews, sound bites, and crucial video footage of his- 

order at any time during the preview. These predefined 25 torical or current events. 

marks can be located on the same object (catalog, card, etc.) Paper-based advertising linked to on-demand multimedia 

or on one or more menu cards. . . 

no. 3 shows an iUustiativc flow chart of the steps , Many °f to<>*y « jOO^^^ff*,*^^ 

involved in operating the present invention. In step 301, ^''^^ fT^^"^^^ a 

uiYuxYsu ui vi/i^iuug m j/i T ~r ' magazine orin direct mail ads. Multunedia ads may be (he 

commumcauonis establish«l bctv/ecn Ae inte^^^ 15 and 30 .^^ ^^^^ 

theseiverl3.Tbscouldbedonebymakmgateb^^^^ ^^^^ access multimecUa presentations by s^sdping bar 

usmg telephone 19a or, if there is a fiiU-tune connection set ^^^^ in the ads tiiat catch their attention. These ads could 

up, by default, then only a few data packets need to be interactions with the company and to ordering, 

addressed from interface 15 to an appropriate servo: 13 via Maely the information that a person browsed through in the 

network 14. The initial selection of server 13 could be made 35 ^.Q^l(i valuable for the company's future marketing 

using pen 11 to tell the interface 15 what server to address. efforts. 

In step 302, the user swipes the paper with the pen 11, which Courses and textbooks 

senses marks oq the paper. In step 302a, the pen 11 may Multimedia lectures could be tied to paper-based text- 

optionally store the mark information for later transmission books. Extensive reading is easier to do on paper, but 

to interface 15. In step 303, as previously described, these 40 animated video explanations and demonstrations are much 

marks may be interpreted within the pen 11 before the more effective for some purposes. The two can be tied 

information is transmitted to interface IS or, to reduce the together by placing bar codes in the textbook that allow 

cost of tiie pen, the pen 11 may send raw scanning infor- students to view parts of a lecture or specific demonstrations 

mation to the interface 15 for processing. In st^ 304, they are interested in. These bar codes could also link the 

interface 15 interprets the received infonnation and may 45 textbook to Uve discussion groups with other students or to 

OTovide audio or visual feedback to the user. Interface 15 live interactions with professors and tutors, 

may also provide feedback to an audible transducer of pen What has been described is merely illustrative of the 

11 to indicate that it has received die scanning information appUcation of die principles of the present invention. Other 

In step 305, the interface 15 communicates interpreted arrangements and methods can be implemented by tiiose 

scanned data to a server via network 14, along witii iofor- 50 skilled in the art without departing from the spirit and scope 

mation tiiat identifies itself and, optionaUy, pen 11. In step of the present mvcntion. 

306, the server 13 communicates with otiier sMTers 17 (e.g., Idaim: 

billing servers, name servers, object database servers). In 1. Apparatus for use with a multimedia server for enablmg 

step 307, one of these servers begins to transmit electronic a user to control the selection of a multimedia service to be 

information to interface 15. The steps 303 through 307 may 55 provided to the user by the multimedia server over a 

involve bidirectional communications. In the case of a communication medium, comprising 

movie, this infonnation might be in the form of an MPEG scanner means, operable by a user, for reading marks on 

data stream, which must be decompressed by interface 15, in an object to obtain information about the object itself, 

step 308, before it can be displayed on die TV (or and for communicating to a user interface a request 

multimedia) receiver 16. In step 309, if there are additional 60 signal including an object code representing the read 

user/server interactions performed, e.g., the ordering of a marks, said scanner means including 

movie once a preview has been seen, control is returned to means for storing die scanned marks and 

step 302. In step 302, die user would swipe across predes- means, operable by a usa, for controlling the commu- 

ignated control function marks (e.g., an "order** mark) to nication of the object code to said interface; and 
perform the ordering function. These control functions can 65 said interface for interfacing the scanner means and a user 

be initiated at any time by a user. In step 309, if no additional display terminal to the communication medium, includ- 

user/server interaction is necessary, then st^ 310 is per- ing 
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receiver means for receiving the request signal from said 
scanner means, 

transmitter means, responsive to the received request 
signal, for transmitting over the communication 
medium to the server a request command including an 5 
interface idandiication code and the object code to 
select the infoormation about the object itself from the 
multimedia service available from the server and 

means for autputting the information about the object 
itself on the user display terminal. jq 

2. The apparatus of claim 1, wherein said multimedia 
server is on the Internet 

3. The apparatus of claim 2, wherein at least one of said 
marks represents an Internet Universal Resource Locator 
(URL). 

4. Apparatus for use with a multimedia server for enabling 
a user to control the selection of an electronic multiinedia 
service to be provided to the user by the multimedia server 
over a communication medium, comprising 

scanner means, operable by a user, for reading marks on 
an object and for communicating to a user interface a ^ 
request signal including an object code representing the 
read marks, said scanner means includes a scanner 
identification code in the request signal communicated 
to said ioterface and 

25 

said interface for inteif adng the scanner means and a user 
display terminal to the communication medium, includ- 
ing 

receiver means for receiving the request signal from said 
scanner means, 3^ 

transmitter means, responsive to the received request 
signal, for transmitting over the communication 
medium to the server a request command including an 
interface identification code and the object code to 
select a multimedia service available from the server, 35 
and 

means for enabling a received selected multimedia service 
from the server to be outputted to the display tenninaL 

5. The apparatus of claim 4 wherein 

said interface includes the scanner identification code in 40 
the request command transmitted to the servers. 

6. The apparatus of claim 1 or 4 wherein said scanner 
means commumcates said request signal to said interface 
over one or more of a group of communication linirg 
including a radio link, an infra-red link and an electrical wire 45 
connection. 

7. The apparatus of claim 1 or 4 wherein said multimedia 
jH-ogram is a broadcast television program. 

8. The apparatus of claim 1 or 4 wherein said scanner 
means reads marks ofiF of a paper object so 

9. The apparams of claim 1 or 4 wherein said interface 
provides visual display feedback to a user in response to 
reception of said request signal. 

10. The apparatus of claim 1 or 4 wherein said interface 

is arranged to communicate with the server over one or more 55 
of a group of communication mediums including at least a 
cable, a wire-pair, an optical fiber, and a radio li'nV. 

11. The apparatus of claim 1 or 4 wherein said scanner 
means reads one or more of a group of marks including at 
least alphanumeric characters, Xerox glyphs, and bar codes. 60 

12. The apparatus of claims 1 or 4 wherein the scanner 
means is a hand-held means. 

13. The apparatus of claim 1 or 4 wherein said marks 
represent a unique object identifier code which identifies 
said object. 65 

14. The apparatus of claim 1 or 4 whereia said object is 
a planar material. 
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15. The apparatus of claim 1 or 4 wherein said object is 
a three-dimensional object having marks placed thereon. 

16. The apparatus of claim 1 or 4 wherein the electronic 
multimedia service includes one or more services selected 
from a group including at least an audio program, video 
program, and electronic document 

17. The apparams of claim 1 or 4 wherein said display 
terminal is one of a television receiver and a multimedia 
computer. 

18. A method for providing a multimedia service to a user, 
comprising the steps of 

establishing a bidirectional communication connection 
between a user terminal and a multimedia server 
location, said connection from said multimedia server 
to said user being capable of carrying a video signal, 

scanning marks on an object to obtain information about 
the object itself, 

storing the scanned marks, 

converting the stored scanned marks into a request com- 
mand including a first code identifying at least one 
video preview and a second code identifying a user's 
terminal, 

communicating, under the control of the user, the request 
command to said multimedia server location over the 
established connection, said multimedia server location 
containing a plurality of video previews, 

selecting, at the multimedia server, the multutnedia service 
having the information using the received request 
command, and 

transmitting a multimedia signal associated with the 
selected multimedia service over the connection from 
the multimedia server location for output at the user's 
terminal. 

19. The method of claim 18 wherein the multhnedia 
service is a video-previews-on-demand service. 

20. The method of claim 18 wherein the multiinedia 
service is one of a group including a praecorded multimedia 
program and a live multimedia program. 

21. The method of claim 18 further including the step of 
controlling the output of the selected multimedia service 

by the user's scanning of one or more of a plurality of 
predefined control marks. 

22. A method for providing an instruction- video-program- 
on-demand service to a user, comprising the steps of 

providing a multimedia server having a plurality of video 
programs accessible by a user in response to a request 
command received from the user, 

establishing a conomunication connection between a user 
terminal and a multimedia server location, 

scanning marks on an object to obtain information about 
the object itself, 

converting the scanned marks into a request command 
including a first code identifying the object and a 
second code identifying the user's location, 

communicating the request command to said multimedia 
server location o\er the established connection, 

selecting, at the multimedia server location, one or more 
multimedia services having the information and asso- 
ciated with the identified object, selected from a group 
including at least a prestored instructional multimedia 
program, a live multimedia connection to a person, and 
a live multimedia connection to a computer 
workstation, and 

transmitting a multimedia signal associated with the 
selected multimedia service over the established con- 
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aection firom the mullimedia server location for outpvx 
at tfac user*s terminaL 

23. The method of claim 18, wherein in said establishing 
step said multimedia server location is accessed via the 
Internet using said bidirectional communication connection. 

24. The method of daim 23, wherein at least one of said 
marks represents an Internet Universal Resource Locator 
(URL). 
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25. The method of claim 18 or 22 wherein said multime- 
dia server is located on the Internet, and at least one of said 
marks represents an Internet UnivCTsal Resource Locator 
(URL). 
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